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F O R E W C D 


The  increase  in  reca'.it  years  of  the  importance  of  analojjue  compu- 
tation as  an  effective  tool  in  engineering  analysis  has  been  accornpliehed 
by  a growth  in  the  complexity  of  the  problerna  being  solved  on  computers. 
Because  this  complexity  has  made  more  difficult  and  expensive  the  op- 
eration of  computers,  knowledge  of  the  errors  in  computer  solutions  be- 
comes necessary  Unfortunately,  the  Increased  problem  complexity 
makes  much  more  difficult  the  estimation  of  the  accuracy  of  solutions. 

In  the  operation  of  the  M.  i.  T.  Flight  Simulator,  the  staff  of  the 
Dynamic  Analysis  and  Control  i.abor.,  .ory  at  the  Massachusetts  Iristituts 
of  Technology  has  recognized  that  the  future  c ontributions  made  by 
analogue -computing  facilities  d ;pcnd  to  a l?irge  extent  upon  whether 
computational  errors  can  be  predicted,  measured,  and  evaluated.  Dis- 
cussiuns  between  the  staff  of  the  D.  A.C.  L.  and  Prof.  F.  J.  Murray  of 
Columbia  University  led  to  a proposal  from  the  D.  A.  C.  C.  to  the  Office 
of  Naval  Research.  This  proposal,  which  resulted  in.  contract  NSori -07879, 
outlined  a study  with  the  objectives  c-f  ”{1)  the  developmenc  of  methods  for 
determining  the  feasibility  of  solving  a given  problem  to  a specified  degree 
of  accuracy  on  a particular  machine  and  (2)  the  development  of  methods 
for  determining  the  accuracy  of  solutions  while  they  a-e  being  studied  on 
a particular  ■:omputer,  " The  present  report  covers  rerearch  on  this  pro- 
gram from  May  16,  I9‘'2  to  May  15,  1953.  Much  of  this  research  has  been 
accomplished  as  S.  M.  tl-.eses  at  M.I.T.  , and  appropriate  references  irndi- 
cate  the  staff  members  whose  contributions  constitute  th**  research. 


Prepared  by;  Approved  by: 


ivi.  V.  Mathews 

Research  Assi.stant 


W.  W. 


Assistant  Director 
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A B 5 i H A C r 

The  work  a<'comoiished  during  the  past  year  at  Ihr  Dynariiii. 
Analysis  and  Control  I_.aboratory  on  error  analysis  for  analogue 
como»'.t«- To  is  sunii.Tia  riiied  and  illustrated  with  examples.  V'arioijs 
methods  of  error  analysis  are  examined  to  ucicrmine  how  they  com- 
hino  to  form  an  effective  error-analysis  tool.  Methods  are.  presented 
for  testing  computer  components  and  f.^r  statistically  describing  their 
errors.  Consideration  has  been  given  to  romponenta  that  are  essentially 
linear  feedback  systems  but  that  include  nonlinearities  such  as  backlash 
and  limiting.  Tht  propagation  of  errors  in  typical  computer  problems 
is  examined  through  the  solution  of  a set  of  linear  differential  equations 
which  -ppreximately  specify  the  error  propagation.  The  linearizing  ap- 
proximations are  justified  experimentally  for  the  problems  considered. 

The  error  propagation  in  a computer  is  examined  experimentally 
and  analytically.  Calculated  errorSj  determined  by  linea.rization  :.p- 
pi  o cimaiions,  are  compared  with  observed  errors.  Practical  clieoking 
methods  to  assure  the  proper  operation  of  a computer  and  to  locate  faulty 
components  and  setup  mistakes  arc  described.  In  conclusion,  suggestions 
for  future  work  are  outlined. 
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Tho  dcvflopiT.cnt  oS  pr.ictical  methods  for  predicting  and  evaluatiig  computer  errors 
's  of  considcr-ibiv-  importam  e because  the  value  of  the  solvations  obtained  from  an  analogue 
coinpuiv'f’  depends  to  a 'arge  i'xiont  on  how  well  computational  errors  can  be  determined. 
The  group  operating  the  M.l.T.  Flight  Simulator  at  the  Dynamic  Anaivsis  and  Control 
Laboratory  is  particularly  interested  in  tliis  problem  of  error  analysis.  Con.sequently, 
members  of  this  group  have  been  engaged  over  the  past  two  years  in  a program  designed 
to  lead  to  a better  understanding  of  the  nature  of  error  generation  and  propagation  in 
analog\ie  computers.  A full  stateincnt  of  the  er ror-analy sis  problem  as  originally  en- 
visioned by  the  Dynamic  An.tlysis  and  Control  Laboratory  is  given  in  a proposal  which 
was  Submitted  to  the  Office  of  Naval  Rt  search  in  March,  195^.  The  proposal  is  summa- 
rized in  Sec . 1.1. 

Most  of  the  work  inclvided  in  this  report  was  accomplished  as  thesis  research  at  the 

1*  2 3 

Tj.A.C.L.  In  particular  the  work  of  M.  Mathews,  H.  Mori,  G.  Rabow,  and 

4 

N.  Treiribath  v/ill  be  summa ri  ^..-d.  Although  some  significant  results  and  a much  better 
under utatidir. g of  the  over-all  problem  h-ave  been  obtained  during  the  first  year  of  work 
under  this  program,  progress  on  the  task  as  originally  outlined  has  not  been  as  great  as 
anticipated  for  two  principal  reasons.  First,  an  unexpected  shortage  of  pcraonne.l  has 
lirxutcd  the  number  of  rs^ian-hours  which  could  ba  allocated  to  the  program  and  thus  con- 
siderably restricted  the  rate  of  progress.  Second,  several  of  the  investigations  pro- 
duced negative  results,  showing  that  some  of  the  objectives  as  outlined  in  the  original 
proposal  were  impractical.  While  the  negative  results  are  worth  obtaining,  their  oc- 
currence has  made  necessary  the  reorientation  portions  of  the  basic  program.  At 
present  this  reorientation  has  not  been  completed  because  some  basic  problems  must  he 
resolved  before  the  direction  for  future  research  can  be  decided. 


1.1.  Brief  Restatement  of  the  Problem. 

The  original  proposal  outlined  certain  specific  areas  which  would  be  investigated 
under  the  error -analysis  program.  Though  they  are  not  divided  precisely  in  this  way 
in  the  original  orograrn,  the  work  of  the  past  year  can  be  divided  best  as  outlined  in 
Sec . 1.11. 


■ SI 


1.11.  Areas  of  investigation. 

Component  Errors. 

In  this  work,  methods  were  to  be  developed  for  testing  and  evaluating  practical  com- 
puter components  in  order  to  determine  the  errors  generated  by  the  comnonents . In  gen- 
eral, the  errors  were  to  be  determined  both  as  random  functions  and  as  functions  of  the 
specific  input  to  the  components.  The  ei  sors  w re  to  be  evaluated  in  a form  which  would 


Refer encoB  are  listed  in,  the  Bibli.ogr.-3iphy  of  Appendix  A. 
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b«  useful  a.j  input  data  in  iho  problem  of  deter  mining  the  error  propagation  in  a.  otjm- 
putcr . 


Problem  Errors. 

A.  Berofid  subject,  for  investigation  was  the  way  in  which  errors  pr.t.pagaie  in  a 
particular  problem  consisting  of  a set  of  differential  equations.  A satisfactory  m.cthod 
of  evaluating  error  propagation  before  a problem  was  set  up  on  a computer  would  pro- 
vide a way  of  seeing  v/hether  the  computer  could  produce  an  acceptably  accurate  solution 
to  the  problem.  Consequently,  this  study  was  to  be  divorced  from  the  characteristics 

of  any  specific  computer,  if  possible,  so  as  to  be  genf'rjiiy  applicable.  Since  a rurnbcr 

" * ' 5 6 

of  theories  for  the  propagation  of  errors  ht  ve  already  been  developed,  ’ the  major  work 
in  this  area  would  consist  in  determining  whether  the  theories  actually  could  be  applied 
to  practical  problems,  and  in  simplifying  the  computations  involved  so  that  useful  in- 
formation could  be  obtained  at  a reasonable  cost. 

Computer  Errors. 

Here  an  experimental  study  of  error  propagation  in  an  actual  compu*ing  machim- 
working  on  a specific  problem  was  to  be  made  The  propagation  of  both  inherent  errors 
generated  by  the  computer  components  of  the  machine  and  artificial  errors  purposely 
injected  into  fha  machine  was  to  be  examined.  By  means  of  this  study,  methods  were 
to  be  developed  to  evaluate  better  the  errors  in  the  machine  solutions  and  to  increase 
confidence  in  the  accur.scy  of  the  machine  results  over  a wider  range  of  variation  in 
problem  parameters. 

1.12.  Additional  Areas  for  investigation. 

Besides  these  studies,  two  problems  which  were  not  considered  in  the  original 
proposal  have  been  added  to  the  error-analysis  program.  Thu  first  of  these  is  an  analysis 
of  the  P'light  Table  section  of  the  M.I.T.  Flight  Simulator,  and  the  second  is  a study  of 
some  practical  operational  techniques  for  improving  computer  efficiency. 

Flight  Table  Report. 

Prior  to  the  inception  of  the  error-analysis  program,  a report  analysing  and  evalu- 
ating the  P'light  Table  section  of  the  M.I.T  Flight  Simulator  had  been  approximately  half 
corrspieted.  The  report  was  not  only  to  describe  the  Flight  Table  in  specific  detail  but 
also  was  to  serv<j  as  a general  explanatii;>n  -of  the  design,  construction,  and  evaluation  of 
a complex  computing  component.  The  publication  of  the  report  was  believed  by  the  Dy- 
na.mic  Analysis  =*nu  Control  Laboratory  and  the  Office  of  Naval  Research  to  be  an  im- 
portant contribution  to  the  field  of  analogue  computati.on.  Ir.  conscque.nce.  part  of  the 
work  of  producing  the  report  was  added  to  the  error  -analysis  program. 
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Practical  Operationai.  Techniques. 

While  the  problems  in  the-  original  error -analysis  propofial  ai 
theoretical,  they  are.  not  considered  from  a viewpoint  as  practical  as  that  take, 
problem  engineer  faced  with  the  operation  of  a computer  on  a specific  problem.  A le- 
view  of  operating  experience  at  the  D.A.C.L.  showed  that  the  efficiency  of  computer 
operation  varies  significantly  aa  function  of  the  skill  of  tlie  operator.  In  particular, 
an  important  part  of  the  operating  time  is  spent  in  finding  and  eliminating  setup  mis- 
takes and  faulty  components,  and  the  extent  of  this  check-up  time  depends  largely  on  the 
operator's  skiP  . As  a rc-nult,  it  wa.s  though  worth  while  to  study  the  trouble-shooting 
techniques  used  by  good  operators,  and  »o  analyze  and  codify  some  of  the  most  success- 
ful techniques. 

2.  GENERAL  OUTLINE  OF  PROGRESS 

Before  the  details  are  given  of  the  work  on  these  studies,  this  section  is  presented 
to  summarize  over-all  progres  t and  to  show  how  the  studies  do  and  {lo  not  combine  to 
form  a unified  error -analysis  tool. 

2.1,  Component  Errors. 

The  study  of  errors  generated  by  components  has  produced  powerful  and  easily 
applied  techninuea  tor  determining  the  average  error  produced  by  .a  component,  given 
the  statistical  properties  of  the  input  to  ;he  component  and  the  statistical  properties  of 
any  noise  generated  inside  the  component  itself.  The  methods  are  .ap  Ucable  to  the  ma- 
jority of  computer  components  that  can  be  represented  as  essentially  linear  devices  that 
are  subject,  however,  to  a number  of  inescapable  nonlinear  limitations  such  as  saturation 
and  stiction.  The  theories  developed  offer  a means  of  ev.aluating  the  average  errors  in 
3.  component  output  and  thus  provide  reaeonabic  methods  for  evaluating  the  quality  of  a 
computer  component.  Nevertheless,  the  methods  for  calculating  the  instantaneous  ti.me 
function  of  the  output  error  resulting  from  a specified  input  to  the  component  are  not  as 
yet  practical . 

Although  now  it  ’s  f*>a«ihle  to  measure  both  the  linear  and  nonlinear  characteristics 
of  most  components  well  enough  so  that  their  errors  with  a,  specific  input  can  be  calcu- 
lated by  numerical-integration  methods,  such  calculations  take  much  too  long  to  be  of  any 
practical  value  in  error -analysis  work.  Most  of  the  techniques  for  the  analytic  investi- 
gation of  the  propagation  of  errors  require  as  data  the  errors  expressed  as  instantaneous 
time  iunct/.ons.  A practical  way  of  calculating  these  time-function  errorr;  is  one  cf  the 
essential  links  still  missing  in  the  general  process  for  evaluating  computational  errors. 
Nor  does  it  seem  that  this  difficulty  will  be  overcome  easily  because  the  problctn  has 


^An  implied  assumption  here  is  that  the  independent  v-iriablo  of  computation  is  time. 
The  assumption  is  trvie  for  the  majority  of  an.alogue  computers. 


b«ien  retiuccd  csaenfiatly  to  one  of  calculiilioi!,  and  the  cal'-ulations  have  boon  proven  to 
be  inordinately  long,  even  with  the  help  of  tlxe  noosi  modern  computiiig  lechniquea . This 
pr'ihlem  is  one  of  the  impasses  delaying  the  error -analysis  program. 

i..l.  Problem  Errors  . 

Analytic  investigations  of  the  propagation  of  errors  in  a system  of  differential 
equations  have  shown  that  the  approximations  involved  in  the  theory  of  these  calculations 
are  justified,  if  not  in  g>  neral,  then  at  least  for  the  systems  of  differential  equations 
that  w-orc  tried.  The  principal  approximation  involved  io  that  the  errors  propagate  ac- 
cording to  a sei  of  linear  differential  equations  even  though  the  problem  consists  of  a 
set  of  nonlinear  differential  equations.  Auultlonal  approximations  are  required  for  the 
solution  of  the  linear  differential  equations. 

The  propagation  of  errors  was  examined  in  a hand-calculated  numerical  check 
which  was  computed  for  a problem  carried  out  on  the  M.I.T.  Flight  Simulator.  The 
error -propagation  analysis  gave  the  approximate  shape  and  magnitude  of  the  errors  in 
the  solution  as  functions  of  time.  Since  for  this  particular  solution  the  actual  errors 
were  Icnown,  the  agreement  between  the  actual  errors  and  the  calculated  errors  could 
be  tneasured.  The  agreement  was  as  good  as  could  be  required  for  error -analysis  work, 
thus  justifying  the  approximations. 

The  problem  studied  was  quite  a bit  simpler  than  problems  now  being  set  up  on  the 
M.I.  T.  Flight  Simulator,  but  probably  it  is  above  the  a^'cragc  complexity  of  thos'i  set  up 
on  the  usual  electronic  differential-analyzer  installation.  Despite  the  fairly  simple  na- 
ture of  the  probltm,  calculating  the  errors  took  approximately  70  man-hours  of  work. 
Vlfhile  this  amount  of  work  might  be  shortened  somewhat  through  the  use  of  ingenious 
methods,  one  is  forced  to  conclude  that  the  calculation  of  errors  seldom  would  be  justi" 
fied  in  dealing  wit’=  practical  problems.  This  conclusion  togeth;r  with  demonstration  of 
the  theoretical  feasibility  of  calculating  errors  is  the  principal  result  from  this  p.art  of 
of  the  error-analysis  work. 

i.3.  Computer  Errors. 

In  the  experimental  investigation  cf  the  prop.ngation  of  errors  in  an  actual  com.puter 
rough.ly  the  same  conclusions  were  reached  as  in  tbe  previous  .'inalytic  investigation  of 
problem  errors;  that  is,  while  the  theories  for  determining  f'-ese  errors  are  unques- 
tionablv  sound,  the  practical  calculations  take  so  mucti  time  on  the  computer  that  only 
very  rarely  would  the  knowledge  of  an  error  be  valuable  enough  to  justify  the  cost  of  its 
determination.  The  complete  evaluation  of  the  errors  for  one  machine  solution  took 
roughly  60  hours  of  machine  ti.me.  The  inachine  time  of  the  M.I.T.  Flight  Simulatoi’ 
costs  approximately  100  per  hour;  hence,  the  total  cost  cf  measuring  the  error  is  large. 
Also,  such  c.  time-consuming  error  meat  ui  ement  defeats  the  purpose  oi  an  aiutlogue  com 
P'jtar  for  most  types  of  probierns,  where  its  great  advantage  is  its  ability  to  obtain  a 
large  numljcr  of  solutions  in  a shore  time. 
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The  main  approximation  involved  in  the  propagaiiou  i.'ieory  is  again  that  the  i-  .-rors 
propagate  according  to  a set  of  linear  differential  cqualionE.  The  approximation  was 
jur.tified  by  solving  the  linear  error -propagation  equations  for  a typiaal  problem.  The 
problem  was  of  average  size  for  the  M.i.T.  Flight  Simulator.  It  involved  IZ  integrations 
and  a number  of  nonlinear  operations  such  as  vector  resolutions  and  multiplications.  The 
solution  to  the  linear  error -propagation  equations  was  obtained  using  the  computer  as  set- 
up to  solve  the  original  problem.  The  solution  was  obtained  in  the  form  of  a set  of  super' 
position  integrals.  With  use  of  the  superposition  integrals,  it  was  possible  to  calculate 
the  errors  caused  by  anv'  component  e.rrors  and  to  compare  the  calculated  errors  with 
actual  errors  observed  in  the  solution.  A good  agreement  between  calculated  and  ob - 
served  errors  was  obtained. 

Wriile  the  theory  for  determining  the  errors  v;as  justified,  the  practical  difficulties 
in  applying  the  theory  were  shown  to  be  great.  The  impasse  in  all  the  error-analysis 
work  done  sc  far  has  not  been  the  failure  of  or  even  the  lack  of  theories,  but  rather  the 
impossibility  of  applying  these  to  achieve  useful  results  with  a reasonable  amount  of  time 
and  effort. 

2.4.  Practical  Operational  Techniques. 

Two  methods  have  been  developed  for  the  rapid  discovery  and  elimination  of  faulty 
computer  components  and  setup  errors.  The  methods  were  evoWed  gradually  by  the  op- 
erators of  the  m.I.T.  Flight  Simulator;  hence,  the  work  done  under  the  error-analysis 
program  consist ;u>  mainly  in  evaluating  and  describing  the  operators'  techniques.  The 
t .VO  methods  discusied  in  this  report  are  general  in  nature  and  can  be  applied  to  a wide 
variety  of  analogue  computers,  not  merely  to  computers  similar  to  the  Simulator. 

The  first  of  these  mv'ithods,  ’’Statje  Checking,"  effectively  eliminates  all  the  time- 
varying  elements  in  the  computer  and  allov/s  the  constants  of  the  nondynamic  elements  to 
be  measured  accurately.  A "Static  Check"  is  a relatively  Bimple,  fast  means  of  assuring 
the  proper  operation  and  connection  of  a large  portion  of  the  computer.  Of  course,  the 
"St.atic  Check"  can  give  no  information  concerning  the  dynamic  computer  elements. 

In  order  to  teat  the  dynamic  elements,  a second  method  called  "Dynamic  Checking," 
was  developed.  A "Dynamic  Check"  exercises  and  examines  both  the  static  and  dynamic 
elements  of  the  computer.  "Dynamic  Checks"  range  from  very  simple  tf'sts  of  single 
computing  elements  lo  complete  te«ts  of  the  operation  of  the  entire  computer.  In  general, 
the  "DynaiTiic  Checks"  are  more  complicated  than  the  "Static  Checks"  and  require  more 
advanced  pt  eparation- 

In  addition  to  developing  these  trouble-shooting  methods,  the  work  of  ev 'iliiatins: 
actual  computer  operating  procediires  showed  that  the  physical  arranger ient  of  the  com- 
puter has  an  important  effect  on  the  time  needed  for  trouble  shooting.  Irx  particular,  it 
was  conciudfi  that  a groat  deal  of  time  could  be  saved  merely  by  the  construction  of  cer- 
tain auxiliary  interconnection  paiicls.  Such  auxiliary  panels  decrease  trouble-shooting 
time  by  providing  rapid  access  to  all  tlie  aignala  in  the  computer. 
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Fli-ht  Tablf^ 


111  Apxrii,  I'/5i,  <1  cornpr ^bcTi sivi;  ^ifvsLiygisi  3in<i.  cvi»biation  D^offram  was  initiated  to 
obtain  positive  infarmation  on  the  aourcea  of  errors  in  the  3-a.xiH  flight  table  associated 
with  the  M.I.T.  Flight  Simulator.  Known  aourcea  of  errors  included  drift,  backlash, 
friction,  saturation,  and  dynamic  effects  associated  with  multiglrnbal  operation.  As  a 
background  for  this  program,  a report  was  to  be  prepared  summariiing  the  status  of  the 
Flight  Table  at  that  time  because  no  such  compilation  of  information  was  available. 

The  preparation  of  the  report,  "Tnteiim  Repor*^  on  the  Flight  Table  Section  of  the 
M.I.T.  Flight  Simulator,'*  has  pro%'en  to  be  a more  extensive  task  than  tirst  visualized. 
To  date,  a large  portion  of  eight  of  the  ten  chapters  has  been  written,  and  the  completed 
report  may  require  between  400  and  500  pages  in  two  volumes,  the  larger  one  unclassi- 
fied, and  the  smaller  classified  SECRET  in  order  to  include  the  results  of  certain  aim.- 
uiator  programs.  Every  effort  is  being  rnade  to  present  a compl  ;te,  accurate  description 
and  evaluation  of  the  Flight  Table,  with  associated  components,  and  to  draw  from  this  in- 
formation positive  conclusions  that  may  serve  as  guides  in.  future  work.  In  order  that  the 
material  v/hich  has  been  written  mav  be  of  immediate  use,  it  is  being  given  a very  limited 
advanced  distribution  in  hectograph  form. 

Concurrent  with  the  preparation  of  the  report,  a number  of  teats  have  been  con- 
ducted to  isolate  sources  of  drifi  and  nonlinear  operation  in  the  servos  associated  with 
the  Flight  Table.  These  tests  utilized  elementary  methods  to  give  information  that  will 
be  helpful  in  improving  servo  performance  before  a more  detailed  analysis  is  made  by 
means  of  methods  diacussed  elsev/hcrc  in  this  memorandum. 


3.  THE  STATISTICAL  EVALUATION  OF  ERRORS 
GENERATED  BY  COMPUTER  COMPONENTS 


The  work  sunjrnarizeu  in  ihia  secljoii  as  directly  applied  to  computer  component?? 

is  taken  from  Mathews'  thesis.  Hc,vever,  in  as  much  as  most  of  the  analogue  computer 

components  are  typical  of  components  used  in  many  other  systems,  the  component- 

evaluation  met.hods  here  presented  have  wide  applications.  Some  methods  that  were 

developed  for  evaluating  the  performance  of  computer  components  have  fs.t  outgrown 

their  original  ai'ea  of  us^lulness  and  are  being  applied  to  a variety  of  s,ontrol  systems, 

Advanced  research  of.  this  type  is  of  a more  general  nacure  and  is  not  of  direct  applicaiion 

to  t!ie  error-analysis  program.  Consequently,  some  of  the  advanced  research  has  been 

separated  from  the  error-analysis  program  and  is  being  done  as  part  of  another  program 

7 H 

Some  of  this  research  is  published  in  two  D.A..C.  L.  reports.  ’ 

The  two  problems  now  to  be  considered  are  the  follov/ing: 

1.  Evaluation  of  the  transfer  characteristics  of  a coioponent. 

2.  Representation  of  component  errors  as  extraneov.s  sources  adding 
errors  to  the  signals  in  the  component. 

In  both  problems,  a statistical  approach  is  taken  Methods  are  developed  for  cstimas.ing 


-10- 


the  avei-aao  values  of  varicufJ  «rron.  The  .-.taristical  approach  ;g  necessary,  p.iitJy  be- 
cause it  is  the  iiiost  realistic  way  of  expressing  certain  inherently  rarrlorn  errors  and 
partly  because  more  specific  methods  of  anaiysis  did  not  prove  feasible  boraus'i  of  the 
lengthy  computr*tions  involvect. 

3.  1.  Evaluation  of  Components. 

Most  computer  components  are  pari  of  a class  of  apparatus  designed  to  oper.ate 
linearly  but  in  wiiich  significant  operating  errors  are  caused  by  inescapable  nonlinearitics . 
Even  nonlinear  components  such  as  multipliers  can  be  included  in  this  class  because  the 
nonlinear  operation  :'s  achieved  by  an  assemblage  of  parts,  most  of  which  are  intended  to 
operate  linearly.  Linear  theory  is  usually  sufficient  to  determino  the  gross  way  in  wliich 
the  companents  function.  However,  in  determining  the  aevialions  between  how  the  com- 
penent  works  and  bow  it  should  work,  the  noiilinca rities  become  very  important  and  must 
be  taken  into  account. 

Two  related  types  of  problems  arise  in  the  evaluation  of  a component . First, the 
linear  and  nonlinear  characteristics  of  the  components  must  be  determined.  Second, 
once  the  character  of  the  component  is  known,  the  errors  gene  ated  when  a given  type 
of  input  is  applied  to  it  rnu  :t  be  calculated.  Numerous  attempts  have  been  made  to  solve 
the  first  problem  by  dismantling  the  component  either  actually  or  figuratively,  examining 
the  cha.racteristics  oi  the  individual  par‘,8  and  then  reassembling  the  individual  character- 
istics to  see  how  the  component  operates.  Usually  the  attempts  have  succeeded  only  par- 
tially, probably  because  it  is  not  possible  to  take  proper  account  of  the  noniinearities  in 
the  parts.  A synthesis  process  in  which  the  coinp-osition  of  a component  is  deduced  from 
its  response  /o  Eultably  chosen  tests  often  proves  more  satisfactory.  The  second  prob- 
lem is  one  of  analysis  because  here  the  system  and  the  input  are  given  and  the  respe  nse 
is  to  be  determined. 

For  lumpcd-cons*ant,  time-invariant  linear  systems,  fairly  general  methods  have 
been  cleveloped  for  both  the  analysis  and  the  synthesis  problems.  As  might  be  suspected, 
.the  synthesis  problem  is  more  difficult  than  the  analysis  problem.  However,  for  non- 
iinear  systems  there  are  no  general  rntthoiis  for  solving  either  problem  In  consequence, 
special  techniques  have  been  developed  for  handling  limited  classes  ol  nonlinear  systems. 
At  tne  present  time,  the  analysis  problem  ha.s  been  solved  more  completely  than  the  syn- 
thesis problem.  A method  has  been  developed  at  the  D.A.  C.  L.  for  det.'r mining  the  ap- 
proximate statistical  response  of  a class  of  nonlinear  systems  to  Gaussian  random  input 
signitls.  The  class  incU'Hcs  aysteme  made  up  of  (1)  linear  elements,  either  passive  or 
active,  with  energy  storage;  (2)  feedback  paths;  and  (3)  nonlinear  elements  without  energy 
storage,  with  an  output  v/liich  can  be  expressed  as  an  instantaneous  function  of  input. 

Thus,  the  class  includes  a great  number  of  computing  elements  with  significant  p.online- 
ariti«:s  such  as  limiting  and  backlash.  Thcefore,  even  though  the  analy.sis  is  not  general, 
it  is  of  great  practical  v,alue. 

The  inputs  considered  are  Gaussian  random,  signals.  Similar  methods  of  analysis 
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ha.vi“  hecii  developed  where  the  inputs  are  amuiOicis.  ’ However,  the  random  - s igna  1 

analysis  possoaees  several  advantages  which  make  ii.  oi  great  interest.  The  signals  in 
computers  are  usually  not  sinusoids,  thus  the  sinusoidal  analysis  ie  not  especially  ap- 
propriate. Furthermore,  the  exact  nature  of  the  signale  is  seldom  known  in  advance, 
and  it  is  necessary  to  characteri7-<'  the  sign.als  statistically.  Also  a statistical  chacac- 
ici  allows  the  rapid  calculation  of  over-all  average  quantities  and  affords  a great 

saving  in  time  over  calculating  the  exact  outputs  from  specific  inputs.  The  analysis 
scheme  considers  only  Gaussian  random  signals,  partly  because  these  are  the  only  type 
of  random  signals  for  which  it  is  as  yet  feasible  to  carry  out  calculations,  ano  partly  be- 
cause Such  signals  are  a realistic  approximation  to  many  computer  signals. 

•It  iS  beyond  the  scope  of  this  report  to  describe  the  details  of  r.%ndom-signal  analy- 

T 8 

a:i8  procedure.  References  are  given  to  two  D.  A.  C.  L,  reports.  ’ One  example  of  tl»e 
results  of  an  analysis  applied  to  a typical  computing  element  is  presented  to  show  the 
general  type  of  information  obtained.  The  computing  element  is  the  electromechanical 
integrator  servo  used  in  the  M,  1.  T.  Fright  Simulator.  A*  block  diagram  ot  the  servo  is 
shown  in  Fig.  1.  The  integrator  is  basically  a rate  servo  using  tachometer  feedback  to 
achieve  an  apprcxim.ate  integration  between  an  electrical  input  and  mechanical  output. 


Fig.  1.  Block  diagram  of  integrciior  servo. 

The  mechanical  output  is  coupled  fbrough  a clutch  and  gear  train  to  a potentiometer  which 
converts  the  mechanical  output  to  an  electrical  sisnal  e,-,  which  is  pronortional  to  the 

a V/  * * 

mechanical  output  times  the  voltage  which  excites  the  potentiometer.  The  analysis 
take«  into  account  the  primary  feedback  loop  including  the  servo  amplifier,  motor,  and 
tachome+er.  The  errors  ini rodv.csd  in  the  gearbox,  clutch,  and  potentiometer  are  con- 
sidered in  Sec.  3.  Z.  Figure  Z shows  a detailed  diagram  of  the  feedback  system  and  gives 
the  time  constants  of  the  various  parts  of  the  system.  The  principal  noniinearity  in  the 
i.ntegrfcitor  is  the  torque  limiting  in  the  servomotor. 

The  response  of  the  servo  to  a random  input  signal  with  a quadratic  power  spectrum 
is  graphed  in  Fig.  3.  The  points  are  experimental  results  and  the  curves  are  analytic 
results.  The  response  measured  is  the  rms  error  E,  because  for  error  analysis  this  is 
more  significant  thar  the.  actual  output  R.  The  response  is  plotted  as  a function  of  the 

Figure  3 j.s  taken  from  D.A.C.E.  Report  No.  70,  in  preparation. 
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Fig.  2.  Detailed  diagram  of  feedback  system. 


Power  spi'iCtrum  of  the  input 
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4 B = y- 

Fig.  3.  Response  of  integrator  scivo. 


rrns  input  I for  variou**  values  of  band- 
v’idtli  of  input  Wj.  It  is  pos.sible  to  see 
heurictically  what  the  shape  of  the  re- 
spense  Curves  should  be  and  that  three 
different  regions  of  operation  should  exist. 
At  low  amplitudes  of  input,  limiting  is  in- 
significant, and  the  erior  is  a linear  func- 
tion of  1 for  any  particular  value  of  Wj. 

As  i is  increased,  the  effect  of  limiting 
causes  the  error  to  increase  more  rapidly 
and  the  E curve  bends  upward  away  from 
the  linear  portion.  If  the  input  was  increas 
sufficiently,  E again  becomes  a linear  func 
ticn  of  t;  this  time  because  E equals  I. 

Here  tne  eervo  no  longer  has  any  error- 
reducing  effect.  Figure  3 shov/s  only  the 
lower  two  operating  regions  since  the  ex- 
perimental data  were  not  extended  to  the 
region  where  E equals  I.  Linear  calcula  ■ 
tioris  can  be  used  to  find  the  response  in 
the  region  of  low  input,  but  a nonlinear 


dnalyfiis  is  p.ccesBary  to  calculate  the  response  ip.  the  mihdlo  region.  The  generally  goo<l 
agreement  betwf  en  the  experin^ental  points  and  the  analytic  curves  of  Fig.  3 justifier^  the 
appToxima!  inns  mafle  in  the  analysis  for  this  particular  case  of  a typical  computer  corn- 
DOfi0nt  • 

The  corresponding  nonlinear  synthesis  problem  can  be  presented  in  terms  of  the 
analysis  problem  just  considered.  The  data  for  the  synthesis  problem  are  the  response 
curves  shown  in  Fig.  3 along  with  such  information  about  the  form  of  the  component  as 
would  always  be  known  in.  a practical  problem.  By  form  of  the  component  is  meant  its 
operational  structure.  In  the  example  the  form  is  that  of  a single-loop  feedback  s'/stem. 
Probably  something  would  also  be  known  aboiit  the  location  and  character  of  the  non- 
linearities.  From  these  data,  the  various  ti.ne  const.ants  and  the  character  of  the  non- 
linearity shnv.’n  in  the  block  diagram  of  Fig.  d.  are  to  be  determined.  The  procedure  for 
the  determi\ 'tion  has  not  be“n  v.’orkcd  out  as  completely  as  the  analysis  procedure. 
However,  enough  has  been  done  to  indicate  the  ustlu'ness  and  importance  of  the  syn- 
thesis method  that  is  leginning  to  be  developed.  The  work  which  has  been  published  is 
in  hlathews*  thesis^  and  no  attempt  will  be  made  to  summarize  it.  Only  two  comments 
will  be  made.  First,  the  synthesis  is  based  on  the  same  approximations  that  are  in- 
involved  in  the  analysis,  and  thus  should  be  valid  for  the  same  type  of  system.  Second, 
snnee  the  synthesis  uses  the  response  of  the  component  as  data,  the  synthesized  system 
vi'iil  respond  in  the  same  way  as  the  actual  component.  The  response  is  the  most  im- 
portant aspect  of  the  component  for  error  analysle.  Thus,  the  synthesis  should  prove 
to  be  an  important  tool  for  error  analysis. 

3 1.  Representation  of  Component  Errors. 

After  a component  has  been  evaluated,  the  problem  of  how  to  represent  the  errors 
produced  by  the  component  still  remains.  Usually  it  is  not  convenient  to  consider  a com- 
puter to  be  mads  up  of  a collection  of  real  components  v<ith  characieriatics  differing 
slightly  from  ideal  components.  The  response  of  such  a computer  would  be  very  diffi- 
cult to  determine  because  real  components  are  much  more  complex  than  ideal  components. 
Instead,  it  is  better  to  consider  the  computer  to  He  conatructed  from  ideal  components 
plus  a number  of  error  sources  that  produce  an  effect  equiv'alent  to  the  rors  generated 
by  the  real  components.  The  errors  in  the  real  computer  can  then  be  determined  as  the 
response  of  the  ideal  computer  to  the  error  sources.  This  determination  ie  difficult,  but 
is  far  easier  than  directly  determining  the  response  of  the  real  computer. 

Most  real  componenis  car.  be  repreeented  in  this  manner,  but  a number  of  sources 
may  be  .-euuvred  for  a good  representation.  As  an  example,  an  error  diagram  used  for 
the  integrator  servo  is  illustrated  in  Fig.  4.  Four  error  summing  points  are  shown. 

At  the  first  two  aumrrii.r'.g  points,  errors  aiisiag  from  (1)  the  inexact  transfer  function  of 
the  real  integrator  , (2)  drift  in  the  integrator  and  (3)  noise  picked  up  in  the  inte- 

grator are  added  to  the  input  and  output  of  an  ideal  integrator.  Each  of  these  errors 
can  be  evaluated  experimentally,  at  least  lor  its  statistical  properties.  The  transfer - 
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Fig.  4.  Integrator  error  diagram. 


function  errors  e.p  are  essentially  those  shown  on  Fig.  3 for  the  caae  of  .a  random  intr - 
Krand  input.  Other  errors  such  as  clutch  slippage  9^,  backlash  in  the  gear  train  Gg, 
and  error  introduced  by  the  potentiometer  e_  are  introduced  at  the  last  two  sumnaing 
points . 

The  definitions  of  these  errors  and  the  points  at  v/hich  they  are  added  into  the  com- 
ponent signal.s  are  in  no  aense  unique.  The  important  consideration  is  to  choose  con- 
venient definitions  both  with  regard  to  the  measurement  of  the  errors  and  the  effect  of 
the  errors  th'C  coTTipoircnt, 

The  problem  of  measuring  er.rors  is  net  trivial.  Tbv'  main  difficulty  in  that  com- 
puter c.ornponents  in  many  cases  have  been  perfected  to  a higher  degree  than  readily 
available  measuring  instruments.  Thus,  the  errors  in  the  components  may  be  smaller 
than  those  in  the  measuring  instrument.  This  difficulty  is  most  severe  for  dynamic 
measur eiTvcnfs.  In  consequence,  indirect  ways  of  measurement  mi;£t  be  developed  for 
many  errors . 

In  the  integrator  servo  example,  the  effect  of  all  the  error  sources  can  be  com- 
bined into  one  error  added  to  the  output  of  the  component..  The  equivalent  circuit  of  the 
real  component  is  shown  in  Fig.  5 where  the  output  error  Eq  may  be  evaluated  from 
Fig.  4 and  is 

Eq  ■ ®D  ^ ®n)^  ®C  ^ ®bJ 

where  Kp  is^  the  conversion  constant  of  the  potentiometer  (volts/ radian)  and  G is  the  gear 

ratio.  The  method  of  representing  the  errors  in  Fig.  5 
<^o j is  convenient  for  studying  the  propagation  of  errors  in  a 

, H~,7\  computer,  as  will  be  shown  in  Sec.  5. 

jDtAL  i _J  *0 

/wESR/soR  j m V Some  of  the  error  sources  in  the  integrator  servo, 

such  as  the  noise  error  S«.  and  thv:  drift  error  arc 

Fig.  5.  Uenresentation  of  , 

^ deii-iiteiy  random  in  nature  and  cannot  be  evaluated  as 
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spt:>.Ific  time  functions.  Other  error  sources,  auch  as  transfer-function  errors  e,,,,  e.'-e 
functions  of  the  input  to  the  servo,  and  could  be  evaluated  as  a specific  time  function  for 
a specific  input.  Still  other  sources,  such  as  backlash  0^  and  potentiometer  errors  Cp, 
are  in  an  intermediatp  grouti  wuich  depend  scmpwhat  on  the  input,  but  also  are  affected 
by  random  variables.  Even  though  it  is  possible  to  calculate  as  a specific  time  func- 
tion, such  a computation  is  exceedingly  long  because  the  nonlinearities  in  the  component 
require  the  computation  to  be  made  by  some  numerical-analysis  method.  In  consequence, 
no  attempt  yet  has  been  made  to  evaluate  time-function  errors  Instead,  statistical 
errors  have  been  evaluated  for  the  case  where  the  component  input  is  a random  signal, 
and  thus  whore  all  the  errors  in  the.  component  arc  random.  For  a random  input,  the 
various  error  sources  in  Eq.  (1)  can  be  assumed  to  be  uncorrelated.  The  mean-square 
is  then  the  sum  of  all  the  mean-square  errors  and  can  be  written 


E=  = k|  [(A^e^dt  t 6^  ♦ o4)o^  t e|  + 0^] 


+ e. 


The  mean-square  output  error  as  given  in  Eq.  (2)  has  been  evaluated  experimentally  for 
the  integrator  servo,  and  is  a measure  of  the  qualify  of  the  servo.  Not  only  does  Eq 
provide  a measure  of  the  total  error  but  also  rnakes  easy  a comparison  of  the  relative 
magnitudes  of  the  various  term.s  that  make  up  Eq,  and  thus  a comparison  of  the  relative 
importance  of  the  various  sources 

For  a typical  component,  anything  approaching  a complete  representation  of  the 
errors  requires  .a  number  of  error  sources.  The  problem  becomes  involved,  even  when 
only  statlinical  errors  are  considered,  as  can  oe  seen  from  the  complexity  of  Fig,  4 and 
Eqs.  (I)  and  (2).  Thus,  for  the  large  number  of  components  in  the  usual  computer  prob- 
lem, a statistical  approach  ix  the  only  one  which  could  possibly  p.*-oducn  an  error-analysis 
problem  of  a manageable  size. 


4.  ANALYTIC  INVESTIGATION  OF  THE  PROPAGATION  OF 
ERRORS  IN  A SET  OF  DIFFERENTIAL  EQUATIONS 


4.1.  The  Problem  of  fSrror  Propagation. 

A knowledge  of  the  way  in  which  errors  propagate  in  a problem  consisting  of  a set 
of  differential  equations  is  of  importance  in  estimatiug  whether  a problem  can  be  solved 
on  a given  computer  to  a specified  accuracy.  How  the  errors  propagate  is  a measure  of 
the  sensitivity  of  the  problem  to  the  errors  that  will  always  be  introduced  by  'he  com- 
ponents of  any  actual  computer.  Th^s  sensitivity,  however,  is  a function  of  the  problnm 
itself  and  not  of  tb<*  specific  computer  on  which  the  problem  is  solved. 

The  work  described  in  this  section  was  done  by  H.  Mori^  in  his  ebesis,  ''The 
Analysis  of  Numerical  Check  Solutions  for  the  M.I.T.  Flight  Simulator."  The  particular 
thesis  problem  was  the  examination  of  the  prooagation  of  errors  in  a numerical  check 
solution.  Although  Mori  actually  dealt  with  numerically  solved  check  soiutiorAS,  hi.? 


work  in  calculating  error  sensitivities  is  of  direct  •nterost  in  the  e r ror -analysi  s prograrrs 
because  the  sensitivity  of  a probl<*m  is  ir.depeudufit  of  how  the  prid^lern  is  solved  and  be- 
cause his  chcck-soiuiion  problems  are  typical  analogue -computer  problems.  Also,  since 
Mori  determined  error  eensiti’  ities  analytically,  without  the  assistance  of  an  analogue 
computer,  the  methods  he  used  might  make  it  feasible  to  estimate  the  errors  ir.  a prob- 
lem before  it  was  actually  solved  on  it  computer — a nroc'odurcr  which  is  one  of  the  ob  • 
jectivea  of  the  error -analysis  program. 

The  meaning  of  the  phrase  "propagation  of  errors;"  should  be  clarified  before  going 
into  the  details  of  iiow  the  propagation  is  evaluated.  It  is  convenient  and  theoretically 
always  possible  to  present  ordinary  differential  equations  in  the  lorm 


“ fc  ( 2 1 > I • • • > > t) 


k = 1,  2, 


The  functions  are  in  the  most  general  case  nonlinear  functions.  The  independent  vari- 
able t in  the  differential  equations  may  be  thought  of  as  being  time  without  any  loss  of  gen- 
erality, and  will  be  so  referred  to  in  the  remainder  of  this  report.  The  solutions  to  the 
differential  equations  are  functions  of  time  and  may  be  written 


k = 1 , c,  . . . , n 


where  S,  (t)  is  the  ea:act  solution  io  the  equations  for  a given  sei:  of  in  tial  conditions.  The 
solutions  depend  not  only  on  the  fj^  functions  but  also  on  the  initial  conditions  which  for 
equations  in  the  form  of  Eqs.  (3)  are  the  values  of  Zj^(O). 

In  solving  the  equations  an  error  might  be  made  in  one  of  the  variables  at  some 
time  The  way  the  error  is  actually  introduced  is  not  important  since  attention  here 
in  concentrated  on  what  happens  to  errors  once  they  are  introduced.  The  assumption  is 
made  that 

' V„> " ® 

where  E is  the  introduced  error.  Introduction  of  the  error  is  equivalent  to  beginning  a 
new  problem  at  time  t^  with  initial  conditions  slightly  different  from  those  of  the  original 
problem.  The  error  in  the  general  case  will  change  all  the  functions  tor  Thus 

it  can  Ce  said  thai  the  error  introduced  at  one  point  wiii  propjgate  through  the  rest  of  the 
solution.  .As  t increases,  the  error  E may  either  decrease  or  increase  depending  on  the 
nature  of  the  f^^  functions.  The  case  in  which  the  error  increases  is  of  course  the  most 
difficult  for  computation,  and  such  problems  can  tv.  called  sonsitive  to  errors.  The  rate 
of  increa“e  is  A measure  cf  the  sensitivity,  and  the  task  for  error  analysis  is  to  find  some 
way  of  evaluating  the  sensitivity. 

The  previous  discussion  has  considered  oiily  the  effects  ori  all  the  variables  of  an 
error  committed  in  one  variable  at  one  time.  In  an  actual  problem  the  effects  of  an  error 
committed  at  any  time  on  any  variable  muat  be  eOiiaidcrcd.  f'hus  a problem  with  n 
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variables,  in  which  ii  is  desired  i.o  examine  Uie  error  characteristics  ai  m diflerent 
times,  will  have  n'  x m sensitivity  functions.  Clearly,  even  a small  problem  v.iii  re- 
quire a great  deal  of  information  to  specify  its  sensitivity,  and  some  way  of  simplifying 
the  requirements  is  essential. 

4.Z.  Unearized  Study  of  Error  Propagation. 

Because  the  introduction,  of  errors  in  a problem  is  equivalent  to  a change  in  initial 
conditions  for  the  problem,  the  propagation  is  governed  by  the  differential  equations  of 
the  problem.  If  these  equations  arc  nonlinear,  then  the  errors  propagate  according  to 
a set  of  nonlinear  equations.  Although  it  is  possible  to  solve  the  nonlinear  equations, 
no  general  methods  exist  for  simplifying  and  extending  the  solutions.  The  error  sensi- 
tivity of  the  problem  always  depends  on  the  specific  errors  made  during  the  sclution, 
and  no  means  is  available  for  separating  the  sensitivity  of  the  problem  from  the  exact 
method  by  which  it  is  solved.  In  view  of  the  large  amount  of  information  required  to 
specify  the  error  sensitivity  cf  a problem,  some  way  to  aimpiily  end  generalize  the  sen- 
sitivities is  a practical  necessity. 

The  method  used  to  achieve  the  simplification  is  to  assume  that  the  errors  are 
sufficiently  small  with  respect  to  the  problem  variables  that  they  propagate  according 
to  a set  of  linear  diffarential  equations.  The  many  general  mathcmatica.l  tools  for  ana- 
lyzing linear  eystems  then  are  available  to  study  the  errors.  In  particular,  superpoaition 
is  applicable,  and  the  separate  effects  of  individual  errors  applied  one  at  a time  can  be 
summed  to  obtain  total  solution  errors.  It  is  thus  possible  to  make  a practical  separation 
between  the  sensitivity  of  a problem  to  errors  and  the  specific  errors  committed  during 
its  solution.  Of  course,  linearizing  the  error -propagation  equations  is  admittedly  an  ap- 
proximation, but  it  is  certainly  a C C S 3 7s  y M pproximation  in  view  of  the  complexity  of 

the  error-analysis  problem.  Mori’s  work  in  showing  the  validity  of  the  linearization  is, 
therefc.-c  of  considerable  significance. 

The  approximation  procedure  used  to  linearize  the  error  equations  is  a fairly 
standard  proceass.  The  particular  methods  used  by  Mori  were  presented  by  Brock  and 

5 

Murray  in  a Project  Cyclone  report.  Slightly  differeiit  methods  have  been  developed  by 
Jones,  ^ atid  these  will  be  discursed  further  in  Sec.  5 which  deals  with  the  propagation  of 
errors  in  actual  computers.  The  lineari.4.ation  method  used  by  Mori  can  be  illustrated  in 
termii  of  the  problem  specified  by  Eqs.  (3).  If  the  equations  are  solved  by  some  inexact 
method,  then  the  approximate  solution  Zj^(t)  can  be  expressed  as 

Zj^(t)  - . . . , n (6) 

w'here  S.  (t)  is  the  exact  solution  and  E-  (t)  is  the  error.  After  substitution  of  Eqs.  (6)  in- 
to  Eqa.  (3)  and  the  asflumptiors  that  E.^(t)  is  sufficiently  smaller  than  Sj^{t),  then  it  cari  be 
assumed  that 
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fJSj,  s^,  . 


. . S ..  t)  + ), 
n ^ ' 


J = 1 J 


k - 1 , Z , . . . , ri 


without  the  introduction  of  a significant  error.  Dvst  since  Sj^(t)  is  the  solution  to  Eqs.  (3), 


= f.  (S, , S,.  . . . S , tt 

X i« 


k = 1.  2,  . . . , n, 


and  Eqs.  (8)  may  be  subtracted  from  Eqs,  (7)  with  the  remainder 


- 1 — - E;(t) 

dt  , d 3 . 

J = 1 J 


k = 1.  2. 


Equations  (9)  are  the  desired  set  of  linear  equations  governing  the  propagation  of  errors. 
Actually  Eqs.  (9>  are  the  homogeneous  equations  for  the  propagation.  Wo  mention  bus 
b'jjeir  made  of  a forcing  function,  consisting  of  the  specific  errors  made  during  the  in- 
exact solution  of  the  original  differential  equations.  The  solutions  to  the  homogenous 
equations  will  specify  compieieiy  liow  the  errors  propagate  and  it  ie  not  dillicult  to  de- 
termine any  particular  solvition  from  the  homogenous  solutions. 

Although  Eqs.  (9)  are  linear,  they  are  not  constant-coefficient  linear  equations. 

The  coefficients  df^/dS.  vary  with  time  not  only  because  they  may  be  direct  functions  of 
time  but  also  because  they  are  functions  of  the  which  vary  with  time.  As  a conse- 

quence, exact  solutions  for  the  equations  cannot  be  obtained  in  terms  of  elementary  func- 
tions. In  order  to  avoid  solving  the  equations  numerically,  a procedure  that  would  have 
taken,  a great  deal  of  computation,  Mori  divided  the  equations  into  sections  in  time  and 
approximated  each  section  by  a set  of  constant-coefficient  equations.  He  was  thus  able 
to  obtain  an  approximate  solution  to  the  equations  in  terms  of  sections  of  analytic  func- 
tiens.  Theoretically,  by  using  many  small  sections,  a very  good  approximation  to  the 
solution  could  be  obtained.  However,  to  save  work,  Mori  used  only  a few  large  sections. 
By  this  fairly  crude  method  he  was  able  to  obtain  an  accuracy  sufficient  for  error  analy- 
sis. Nevertheleeo,  it  sho>old  be  pointed  out  that  there  are  two  essential  approximations 
in  his  final  error -propagation  solutions.  Th»*  first  is  the  linearir.ation  of  the  original 
equations,  and  the  second  is  the  approximation  of  the  linear  equations  by  piecewise 
constant-coefficient  equations. 

Most  of  the  time  spent  in  evaluating  the  error  propagation  in  the  problems  that  Mori 
considered  was  used  to  solve  the  piecewise  constant-coefficient  equations.  The  details  of 
solving  the  equations  are  straightforward  and  are  not  of  sufficient  interest  to  be  included 
here.  Matrix  methodc  were  used  to  allow  orderly  calculations  and  to  obtain  the  required 
general  homogeneous  solutions  to  the  equations  with  all  arbitrary  censtants.  The  i-roS- 
lem  considered  reduced  to  four  indepsendent  variables;  hence,  4 v 4 matrices  were 
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involved.  The  main  work  of  the  aolution  consiated  of  fii.ding  the  characteristic  roots  and 
characteristic  veciero  for  the  matrices  corresponding  to  each  of  the  piecewise  constant - 
coefficient  sections.  An  a typical  example  of  the  amount  of  time  involved,  approximately 
70  man-hours  of  work  wore  required  to  solve  one  problem  that  was  divided  into  three  sec- 
tions. This  is  approximately  the  same  time  as  required  to  obtain  a complete  solution  to 
the  original  problem  by  numerical -integration  methods  using  a desk  calculator. 

4.3.  Practicability  of  Analysis  of  Propagation  of  lirrors  i lA  Differential  Equations. 

The  particular  check  solution  that  was  examined  as  a s.ample  problem  was  chosen 
partly  beca.use  two  solutions  to  the  problem  were  available,  one  of  very  high  accuracy, 
the  other  of  rather  poor  accuracy.  Thus,  the  errors  in  the  second  solution  couiu  be  com 
pared  with  errors  calculated  in  an  error -propagation  analysis,  providing  a check  on  the 
propagation  analysis. 

The  problem,  put  in  the  form  of  Eqs.  (3),  is  the  following: 


dY 

= A sin  0 + B sin  kt 

(10) 

dt 

dX 

= A cos  0 + B cos  kt 

(11) 

dt 

do 

s a, 

(12) 

dt 

d4x 

= f(X,  Y,  G.  4.) 

(13) 

dt 

where  X,  Y,  6,  and  ij;  arc  the  dependent  variables  and  t is  the  independent  variable.  The 
problem  solution  is  of  interest  for  t between  ^c•^o  and  T.  The  linearized  error-propagation 
equations  corresponding  to  Eqs.  (9)  are 


dE, 

dt 

dE, 

dt 


= A(c08  0)E 


0 


= - A(sin  0)E, 


(14) 


(15) 


J IT 

O 


= E, 


dt 

HF. 


'P 

'P  = df 


dt 


-AL.  E„  + Al  E„  + E. 

dX  ^ de 


(16) 


(17) 


where  E„,  E„,  E„,  and  E,  are  the  respective  errors  in  Y,  X,  G,  axid  vjj.  The  coefficients 

y X 


in  Eqs.  {14)  through  (17)  are  functions  of  ti 


For  example,  in  Eq.  \14)  A sin  0 varif^s 
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with  time.  By  an  eicamination  of  the  variation  uf  the  roefficienta.  the  problem  was 

rougliiy  sectioned  into  three  parts,  0<t<0.4T,  0.4T<t<0.ST,  and  0.8T<t<T,  Figure 

. 

6 shows  a typical  solution  to  one  of  the  linearized  sections  of  Eqs.  (14)  through  (17). 

Here  ti.e  error  propagated  in  X caused  by 
an  error  injected  into  X is  graphed.  In 
this  case  the  propagated  error  decreases 
with  time,  demonstrating  that  this  par- 
ticular portion  of  the  problem  is  not  very 
sensitive.  Naturally,  many  other  propa- 
gation functions  like  Fig.  6 would  have  to 
be  shown  to  specify  completely  the  error 
sensitivity. 

Th.e  over-ail  error  in  X caused. by 

all  the  computational  errors  is  shown  in 
2 t 

Fig.  7.  The  calculation  of  the  erior  in 
X roquirsd  estimating  the  errors  committed 
during  the  solution  of  the  check  solution. 
However,  because  the  check,  solution  was 
solved  numerically,  this  estimation  was  possible.  In  Fig.  7 the  calcMVaten  errors  are 
compared  with  the  observed  errcirs.  The  calculated  errors  agree  very  well  with  the 
observed  errors  for  small  values  of  t,  and  for  ail  values  of  t the  calculated  errors  show 
the  order  of  magnitude  of  the  observr^d  errors.  The  apparent  discontinuity  in  the  observed 


Fig.  6.  Error  in  X caused  by  unit  error 
injected  into  X. 


Fig.  7.  Obeerved  and  calculated 


Figure  6 is  adapted  from  Fig.  3.3  of  Mori  c thesis. 
*^Figure  7 ia  adapted  from  Fig.  3.  1 1 of  Mori'a  thesis. 
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error  vvai;  due  to  unusual  addition  of  the  round-off  eirors  made  during  the  numerical  so- 
lution of  the  check  solution.  This  round-off  error  was  not  taken  into  account  in  the  c<il- 
culated  error  response.  Had  the  round-off  error  been  taken  into  account,  a much  better 
agrecme,nt  between  che  two  error  curves  would  have  been  obt, lined. 

The  accuracy  of  the  calculated  error  curve  is  certainly  as  good  as  is  required  to 
estimate  error  magnitudes  in  practical  .applications.  Thus  the  approximations  made  in 
linearising  the  er  ror-propanatioa  equations  and  in  sectioning  the  time-varying  linear 
equations  are  justified. 

Several,  conclusions  can  be  drawn  from  the  analysis  and  examples  of  error  propa- 
gation in  a problem.  A good  estimate  has  been  obtained  of  the  requirements  for  deter- 
mining the  error  sensitivity  of  a problem  and  for  predicting  the  errors  that  will  be  made 
by  solving  the-  problem  with  some  actual  computer. 

In  order  to  calculate  the  error  sensitivity,  it  is  necessary  to  have,  in  addition  to 
the  differential  equations  the  problem,  an  approximate  solution  to  the  problem.  Know- 
ledge of  the  approximate  solution  is  neceesary  in  order  to  evaluate  the  d f, /dZ.  coefficients 

k j 

in  the  error-p  opagation  equatioc.  However,  as  was  shown  by  the  success  of  the  fairly 
crude  approximations  used  in  the  example,  only  a rough  idea  of  the  solution  is  necessary. 
The  time  required  to  calculate  the  sensitivity  depends  on  the  size  of  the  problc.m,  the 
'jize  being  mea.sured  by  the  number  of  variables.  A four -variable  problem  took  approxi- 
mately 70  man-hoijrs  to  compute.  The  amount  of  work  required  to  manipulate  a matrix 
varies  approvirnatcly  as  the  factorial  of  the  size  of  the  matrix;  hence,  the  time  required 
increases  very  rapidly  as  the  number  of  variables  is  increased.  Mori  is  of  the  opinion 
that  sensitivities  of  problems  with  more  than  five  variables  will  have  to  be  calculated 
with  the  help  of  an  automatic  digital  computer  because  hand  calculations  would  be  too 
t-idious.  Usually,  it  would  be  desirable  to  make  rapid  estimates  of  a problem  sensitivity 
prior  to  its  acceptance  for  study  on  an  analogue  computer.  Making  rapid  estimates  would 
require  the  immediate  availability  of  a digital  computer,  preferably  in  the  same  labora- 
tory with  the  analogue  computer.  The  combination  of  digital  and  analogue  computing  fa- 
cilities might  be  very  effective  for  studying  a number  of  ki.nds  of  problems.  However, 

Such  a combination  v»\  uld  be  too  expensive  for  a smell  organization  to  maintain. 

A knowledge  of  the  error  sensitivity  of  a problem  may  be  sufficient  to  evain.ate  its 
computability.  However,  if  it  is  desired  to  estimate  the  errors  that  will  be  made  on  the 
problem  with  a given  computer,  then  the  actual  time-function  errors  introduced  by  the 
computer  components  must  be  known  as  well  as  the  problem  error  sensitivities.  As 
was  pointed  out  in  Sec.  3. 2, calculation  of  the  time-function  errors  is  not  feasible  because 
it  takes  too  long.  Also  if  the  linearity  and  piecewise  constant -coefficient  assumptions 
are  allowable,  determination  of  the  propag.aied  errors  from  the  injected  errors  is  a long 
computation.  The  over-all  conclusion  is  that  it  is  not  worthwhile  attempting  to  estimate 
specific  propagated  errors  analy^iically  by  the  methods  of  this  section.  On  the  other  hand, 
the  estimation  of  error  sensitivities  may  or  may  not  be  justified  dependin.g  on  trie  specific 
problem  at  hand  and  the  facilities  available  to  make  such  an  estimate. 
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5.  experimental  investigation  Oi  THE 
PROP  A G A T I O N OF  ERRORS  IN  A C O M P U i'  E R 

A»  part  of  the  crror-analysia  study,  the  actual  errors  in  a computer  solving  a 

typical  problem  were  to  be  investigated  experimentally.  The  general  purpose  of  the  in- 

veatiga,tion  was  to  develop  p.artical  operational  techniques  for  estimating  the  errors  in 

the  computer  solutions.  The  line  of  attack  on  the  problem  was  to  measure  the  sensitivity 

of  the  problem  to  errors  of  the  type  that  are  produced  by  the  computer  components  and 

tc  correlate  this  sensitivity  with  ihc  actual  errors  observed  in  the  computer  solution.  It 

particular,  ii  w.»s  desired  to  determine  the  amount  of  computing  time  required  to  obtain 

sufficient  error- sensitivity  data  to  estimate  with  confidence  the  errors  in  a particular 

computer  solution  or  set  of  solutions.  The  major  part  of  this  particular  investigation 

3 

was  carried  out  by  Rabow,  and  the  details  of  this  work  arc  reported  in  his  thesis. 

5.  1.  Einearissation  nf  propagation  Analy?*i«. 

In  order  to  analyze  the  propagation  of  errors  in  a computer,  it  is  necessary  to 
assume  that  the  errors  are  relatively  small  and  thus  that  they  propagate  according  to  a 
act  of  linear  differential  equations.  A similar  linearity  assumption  was  required  in 
Sec.  4.Z  dealing  with  the  propagation  of  errors  in  a set  of  differential  equations.  Methods 
also  were  given  in  Sec.  4.  ?.  for  finding  the  linear  differential  propagation  equations  and 
for  obtaining  approximate  analytic  solutions  of  them.  If  the  errors  are  to  be  determined 
experimentally,  it  is  not  necessary  to  exhibit  the  error  equations  because  they  can  be 
solved  experimentally  on  the  computer  as  set  up  to  solve  the  original  problem  for  which 
the  solution  errors  are  to  be  determined.  However,  it  is  essential  to  know  that  the  prop- 
agation equations  are  linear,  and  thus  to  be  able  to  specify  the  form  of  the  solution.  Also, 
while  in  Sec.  4.  Z solutions  o£  the  homogeneous  propagation  equations  were  of  the  greatest 
interest  in  specifying  the  error  sensitivity  of  the  problem,  here  the  main  interest  is  cen 
tered  on  particular  solutions  of  the  propagation  equations.  As  a consequence,  the  ways 
in  which  errors  are  committed  in  actual  compviters  must  be  considered.  Errors  will  be 
referred  to  as  being  ii'-jccted  by  the  computer.  The  precise  meaning  of  injected  errors 
will  br  made  clear  subsequently. 

The  particular  solution  to  a lisie.ar  differential  equation  can  always  be  expressed 
as  a superposition  integral.  Where  the  equations  do  not  have  constant  coefficients,  the 
kernel  of  the  integral  is  a general  function  of  two  variables.  The  method  of  expressing 
the  error  propagation  in  terms  of  superposition  integrals  was  used  by  Jones.  ^ An  error 
in  a dependent  variable  of  computation  can  be  written 

E {t)  = f A (t.  r)e  (T;dT.  (18) 

pq'  ' J pq'  q 
0 

The  quantity  E (t)  i.s  the  error  in  the  variable  p caused  by  an  error  e (t)  injected  into 
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variable  q.  Both  E It)  and  e (t)  are  functioiiB  of  time.  The  kernel,  X ,^„{t,  t),  can  be 
‘ pq  q pq 

considered  to  represent  the  response  at  time  t to  a unit  impulse  error  injected  at  time 

T.  I'he  total  error  in  variable  p is  the  sum  of  the  errer/j  produced  by  errors  injected  in 

all  the  other  variables.  Thus,  in  order  to  specify  the  errors  in  ail  the  variables  in  an  n 

variable  oroblein,  kernelu  must  be  determined.  In  the  computer.  X (t,  t)  can  be 

pq 

measured  as  a continuous  function  of  t,  for  discrete  values  of  r.  If  m values  of  t are 
considered,  then  m x functions  are  required  to  specify  completely  the  error  propa- 
gation in  the  problem.  Thus,  the  same  amount  of  information  is  required  here  as  was 
reqviired  to  specify  the  problem  error  sensitivity  in  Sec.  4,1.  Indeed,  Mori  has  shown 

that  it  is  possible,  though  imoractical,  to  calculate  the  superposition  integral  kernels 

3 

from  the  error  sensitivities.  The  experimental  methods  developed  by  R.abo’A  for  eval- 
uating the  kernels  are  more  practical. 

It  is  important  to  define  injectad  errors  precisely  and  to  distinguish  between  the 
error  injected  into  a eomp‘.i>er  variable  and  the  resulting  error  caused  by  the  injected 
error.  Although  injection  could  be  defined  in  a nunnber  of  ways,  the  most  convenient  defi- 
nition found  ao  far  is  to  consider  the  injected  error  to  he  added  to  the  variable  it  affects. 
Thus,  for  example,  in  Fig.  8 the  variable  generated  at  aome  point,  a,  in  a com- 

puter and  is  transmitted  to  other  points,  b,  c,  and  d.  in  the  com- 
puter. To  inject  an  error  e^^  ) into  Z^(t),  the  Zj^(t)  channel  is 
broken,  and  a summing  circuit  is  inserted,  as  shown.  For  the 
example,  «j^(t)  can  be  considered  the  only  error  injected  into  the 
computer.  If  e^(t)  = 0,  then.  equals  lit®  exact  solution 

to  the  problem.  For  ®j,(t)  f 0,  '''til  equal  Sj^(t)  plus  some 

error  Ej^{l)  that  is  produced  by  the  injected  error,  ®jj(l)-  ^ can 

be  seen  that  unless  the  computer  contains  no  feedback  loops  between 
h,  c,  or  i,  and  a,  ®j^(t)  t thus  the  injected  error  will  not 

equal  the  resulting  error.  The  usual  computer  problem  requires 
feedback  loops.  In  this  case  E,_(t)  must  be  determined  from  e.  (t) 
by  -means  of  a superposition  integral  with  t)  for  a kernel. 

There  arc  two  principal  advartuges  to  defining  error  injection  by  a summation. 

First,  as  was  pointed  out  in  Sec.  3.2,  it  is  possible  to  represent  component  errors  as 
extraneous  variables  that  arc  summed  with  the  output  of  the  component.  Thus  component 
errors  can  be  treated  directiy  as  injected  errors.  Second,  since  summing  circuits  are 
readily  available  in  most  computers.it  Is  possible  actually  to  insert  summing  circuits  in 
the  channels  of  the  variables  and,  by  injecting  artificial  errors,  to  evslviate  the  kernels 
of  the  superposition  integrals. 
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Fig.  8,  Error  in- 
jection by 
addition. 


5.  2.  Experimental  Evaluation  of  Superposition-Integral  Kernels. 

An  experimental  evaluation  of  the  superposition-integral  kernels  was  carried  out 
for  a typical  problem.  The  same  computer  setup  was  used,  to  solve  the  problem  and  to 
evaluate  the  ker»»els,  except  for  addition  of  some  summing  circuits  in  the  latter  process 
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to  faciiitatt:  the  injection  of  artificial  errora  into  the  computer.  The  use  of  CRsentiaily 

the  same  setup  for  aolving  the  problem  and  for  evaluating  the  error  kernels  is  necessary 

if  the  evaluation  of  the  error  kernels  ia  to  be  a feasible  operational  method  for  estimating 

solution  errors  while  the  problem  is  being  solved. 

The  kernels  were  evaluated  by  obtaitung  the  response  to  artificially  inject^'d  errors. 

The  response  and  Ihe  injected  error  were  need  in  equations  of  a type  similar  to  Eq.  (18) 

io  eicTve  for  the  kernel,  X (t,  t).  Injection  waa  accomplished  by  means  of  summing  cir- 

pq 

cviits,  as  illustrated  in  Fig.  3.  There  is  nothing  in  Eq.(18)  that  restricts  the  type  of  in- 
jected error  e tt),  which  may  be  used  to  evaluate  X {t,  t).  However,  e (t)  must  satisfy 
certain  other  r equiremei’t?! , both  of  a theoretical  and  of  a practical  nature.  The  kernel 
X (t,  t)  could  be  cv'aluated  most  simply  bv  injecting  an  impulse,  error  into  the  q variable 

at  time  t,,  since  for  these  conditions  the  resulting  error  E (t)  would  eq^-.a!  (t,  t ). 

1 pq  pq  1 

Because  linearity  requires  that  the  errors  be  small,  it  is  necessary  to  approxinrate  the 

impulse  error  by  a pulse  of  finite  height 

INJECTED  ERROR  j | j and  width.  The  response  to  the  finite  pulses 
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. that  step-function  injected  errors  were  usu- 

ally more,  satisfactory  than  pulses  because 

Fig.  9.  Error-response  keruels,  they  were  easier  to  generate  experimentally, 

Xpq^^’  and  because  it  was  easier  to  obtain  a 
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S'igure  9 is  adapted  from  Fig.  Z-1  of  REibow's  thesis. 
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lAfge  enough  to  measure  -vithout  exceeding  linearity  iiiiiitationo . The 
t)  of  Eq.  (18)  can  be  calculated  by  diffcrcntiatiiig  the  reiiponse  to  a ate 
or  a different  superposition  integral  may  be  considered. 
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For  a B\-nerposition  integral  of  the  type  of  Eq.  (19),  the  kernel  rpq(l>  ti)  1®  obtained 
direcily  as  the  response  E^^(t)  to  a step-function  error  applied  at  time  Tj. 

With  either  type  of  superposition  integral,  the  errors  produced  by  component  mal- 
functioning can  be  calculated.  The  errors  in  the  p channel  produced  by  a simple  gain 

Figure  10  shows  the  calculated  error  com- 
pared with  the  error  r.ctually  observed  in 
the  computer  with  the  q channel  gam  pur- 
posely misadjusted.  The  example  shown 
in  Fig.  10  is  of  necessity  a simple  one  be- 
cau9"  the  errors  injected  by  the  faulty  com- 
ponent must  be  of  such  a type  that  they  can 
be  calculated  in  a reasonable  time.  How- 
ever, the  conclusions  from  the  simple  ex- 
ample apply  to  the  more  complex  case.  The 
close  agreement  between  the  calculated  and 
measured  errors  i.hows  the  validity  both  of 
the  linearity  approximations  made  in  the 
error-propagation  analysis  and  of  the  methods  used  to  evaluate  the  superposition  kernels. 

a.  3.  Practicability  of  Analysis  o-  Propagation  of  Errors  in  a Computer. 

The  agreement  between  calcuiat'^id  and  observed  errors  in  Fig.  iO  has  shown  that 
if  the  errors  generated  by  computer  components  are  known,  it  is  possible  to  calculate  the 
errors  produced  in  the  computer  solutione  from  the  supeipoBition-integral  ke.rnels.  How- 
ever, calculation  of  the  errors  does  not  appear  to  be  feasible  in  rriost  practical  problems 
for  three  reaoorK.  First,  as  has  been  pointed  out  in  the  last  tv/o  sections,  it  is  not  fea- 
sible to  find  the  actual  time-function  errors  generated  by  com{ioneiila . .Second,  for  a prob- 

2 

iem  c£  reasonable  size,  measuring  all  the  n x m kernels  required  to  describe  completely 
the  error  propagation  takes  excessive  computer  ti»ne.  Third,  even  after  values  of  the 
kernels  and  the  injected  errors  have  bee.n  obtained,  the  actual  computations  to  procure 
the  resulting  errors  arc  long. 

Instead  of  trying  to  calculate  actual  solution  eriort,,  it  m.^y  be  possible  tc  obtain 
some  iiiformation  concerning  the  magnitude  of  solutioii  errors  for  a particular  computer 

Figure  iO  is  adapted  from  Fig.  2- 2b  of  Rabow*s  thesis. 
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Fig.  10.  Er’"or  in  p caused  by  a gain 
error  in  the  q channel. 
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from  the  Si'n,“  Ltivit  y of  the  probleni  to  t-rrors  as  expresfit-d  by  the  superposition- integral 
kernels.  Tlio  assumption  involved  is  that  the  tomponente  of  the  computer  wiii  alivays 
generate  the  same  magnitude  of  errors;  lien'-e,  the  resulting  solution  errors  will  bo  pro- 
portional to  the  magnitude  of  the  kernels.  Such  an  assumption  is  crude  and  would  have 
to  be  justified  experimentally  rather  than  being  proved  analytically.  With  such  an  as- 
sumption, it  could  be  predicted  that  a computer  which  produced  acceptably  a-ceurate  so- 
lutions to  one  problem  would  produce  solutions  of  similar  accuracy  to  another  problem 
with  a similar  sensitivity.  The  use  of  such  an  assumption  appears  to  be  the  only  reaeon - 
able  way  of  estimating  the  magnitude  of  the  solution  errors. 

The  use  of  such  an  assumption  still  requires  experimental  evaluation  of  all  the 
svpcrposition-integral  kernels.  However,  if  something  is  known  in  advance  about  the 
error  sensitivity  of  the  problem,  it  might  be  possible  to  reduce  the  amount  of  experi- 
mental data  required.  Thi^  advance  knowledge  perliaps  would  be  available  from  experi- 
ence in  working  similar  problems , By  learning  trom  past  c-xperience  which  kei-nela 
were  especially  large,  a good  idea  of  the  error  sensitivity  could  be  obtained  by  evaluating 
only  these  critical  kernels.  Thus  the  work  required  to  estimate  the  solution  errors  would 
be  significantly  reduced. 

One  important  limitation  to  the  process  of  estimating  errors  from  the  experimentally 
determined  error  sensitivities  must  be  emphasized.  In  applying  a linear  analysis,  the  a 
priori  assumption  is  made  that  the  errors  are  small.  If  the  computer  produces  a com- 
pletely incorrect  solution,  the  sensitivity  measurements  give  no  indication  that  the  solu- 
tion is  incorrect.  The  sensitivities  measured  for  the  inec>rrect  solution  may  show  that 
iba  solution  is  relatively  insensitive  to  component  errors,  and  give  no  indication  that 
large  errors  have  been  committed  by  the  computer.  An  example  of  . uch  behavior  occurs 
when  a computer  solution  becomes  unstable  through  the  influence  of  small  extraneous  time 
lags  ill  the  dynamic  computing  elements.  The  true  solution  to  the  problem  in  this  case  is 
not  unstable,  and  will  differ  greatly  from  the  computer  solution.  The  sensitivity  analysis 
can  not  chow  whether  the  inatabilitv  is  caused  by  computer  errors  or  whether  the  original 
problem  is  unstable. 

b . practical  techniques  for  detecting  and  e j.i  Ni  ina  t in  G 

ERRORS  IN  COMPUTERS 

b.  I Importance  of  Practical  Techniques. 

As  mentioned  in  Sec.  Z,  experience  with  the  M.l.T.  Elighi  5in-iuiaU,r  has  .show'n 
that  operational  troubles  can  impair  the  efficiency  of  a computer.  Aiihough  originaiiy 
it  was  not  thought  worth  while  to  study  these  practical  problems  in  the  error-analysis 
program,  they  have  oroved  to  be  actually  more  imnortani  than  Bome  of  the  problems 
originaiiy  included,  particularly  when  importance  is  measured  in  terms  of  coinputing 
cost.  The  practical  troubles  are  best  described  from  the  point  of  view  of  an  operator 
running  a large  computer.  Since  Ihe.  operation  of  the  compu*^er  is  complex,  the  operator 


may  havp  little  i:sider standing  of  whether  or  not  the  computer  is  functioning  correctly, 
and  ever,  if  he  know*  the  cornputcir  I'a  nia.'.tunctioning,  he  has  little  intuitive  idea  of  the 
scurcs  of  the  trouhlt.  Difficulties  arise  both  from  human  mistakes  and  component  fail- 
ure. In  a complicated  problem,  both  the  probability  of  human  error  and  the  probability 
of  component  failure  will  be  accordingly  large,  Thus,  in  the  course  ot  a problem,  and 
more  particularly  at  the  beginning  of  the  problem,  a number  of  troubles  tha.  must  be 
eliminated  before  problems  can  be  successfully  solved  are  almost  certain  to  arise.  The 
operator's  job  is  to  eliminate  the  difficulties  as  quickly  as  possible.  Fast  elimination  of 
troubles  requires  a rapid  method  for  localizing  the  mistake  or  the  malfunctioning  com- 
ponent. In  addition,  the  probability  of  making  a second  mistake  while  correcting  the 
original  one  must  be  kept  low.  A number  of  rather  general  trouble-shooting  techniques 
that  meet  these  requirements  have  been  ilcveloped  at  the  D.  A,  C.  L.  The  tech.niques  are 
applicable  to  a wide  class  of  analogue  computers,  and  thus  it  is  believed  they  represent 
a significant  contribution  to  computer  operating  methods. 

As  expected,  most  of  the  trouble-shooting  techniques  have  been  developed  by  people 
closely  corrected  with  computer  operations.  Th**  techniques  summarized  in  this  report 

4 

are  presented  in  a thesis’  by  Tremhath-  The  subject  of  ?'rembath'8  thesis  is  the  simu- 
lation of  three-dimensional  flight  paths  Such  simulation  is  one  of  the  most  complex: 
computer  problems  studied  on  the  M.I.T.  Flight  Simulator  to  the  present  time,  and  in 
Trembath's  work,  Sec.  3 on  erro’*8  and  mct'nods  of  checking  computers  is  an  excellent 
presentation  of  t rouble -s'hooting  techniques,  especially  as  applied  to  a large,  complex 
problem. 


6.2.  Static  Checking  Methods. 

One  of  the  simplest  methods  fo  r oSsvv  ring  the  proper  operation  of  a number  of  com- 
puter components  ai  well  as  for  localizing  troubles  is  a static  gain  check.  Computer 
components  can  be  divided  into  static  and  dynamic  elements.  A typical  of  the 

former  is  an  amplifier  with  an  output  that  is  merely  a constant  times  its  instantaneous 
input,  and  a typical  example  of  the  latter  rs  an  integrator  where  the  output  changes  with 
time,  even  for  a coii^tant  input.  By  eliminating  the  dynamic  elements  in  -a  particular 
computer  setup,  it  is  posoible  to  n^ke  a slow  and  careful  check  of  the  proper  operation 
of  the  static  elements.  For  instance,  in  a computer  consisting  entirely  of  integrators, 
summing  circuits,  and  amplifiers,  by  fixing  the  integrator  outputs  at  predetermined 
values  and  by  measuring  the  signals  throughout  the  system,  it  is  possible  to  deduce 
'sv?hathsr  all  the  summing  c.ircuits  and  amplifiers  are  functioning  correctly.  The  gains  of 
either  individual  elements  or  groups  of  elemeiLts  may  be  measured  and  compared  with 
predetesTAin.ed  «rorrect  values  Thus  a systematic  method  is  provided  for  localizing  er- 
rors by  gradually  decreasing  the  number  of  elements  in  the  group  under  teat. 

In  makinp  static  c’necks,  it  is  important  to  have  convenie.ut  check  points  that  allow 
the  rapid  mear.i-roments  of  the  signals  throughouf.  the  computer  without  the  necessity  for 
disturbing  the  computer  setup.  In  maisy  cases,  the  orri:r.ary  interconriection  p.inel  or 


patch  panel  on  which  the  various  computing  elements  are  interconnected  does  not  form  a 
satisfactory  set  of  test  points  for  checking  purposes.  Usually,  the  connection  points  on 
the  panel  are  somewhat  obscured  by  the  intarccnnectiuo  wires  which  cover  the  panel. 

Also,  in  many  cases,  it  is  necessary  to  break  into  a given  signal  charine)  and  insert  a 
irmitiple  connector  in  order  to  measure  the  signal  in  the  channel.  Disturbing  the  patch 
panel  tends  to  introduce  further  mistakes  into  the  computer  setup,  and  thus  in  a com- 
plicated problem,  the  probability  of  creating  a new  error  may  be  almost  as  high  as  the 
probability  of  finding  an  existing  error.  To  overcome  this  difficulty,  duplicate  patch 
panels  have  been  installed  cn  the  M.I.T.  Flight  .Simulator.  All  computer  signals  h«\ve 
been  brought  out  to  the  duplicate  patch-panel  ternrinals  . hich  are  used  solely  for  testing. 
The  auxiliary  terminals  not  only  make  the  testing  process  faster  and  more  convenieiit 
but  also  eliminate  errors  introduced  by  disturbing  the  original  wiring. 

In  addition  to  locating  gross  errors,  it  has  been  found  that  a complete  static  check 
performed  periodically  assists  in  locating  components  that  are  gradually  developing  er- 
rors. Thus,  a static  check  is  a "aluablc  tool  in  m-aintaining  the  highest  possible  accuracy 
in  the  system. 

6.  H.  Dynamic  Checking  Methods. 

Tlxe  value  of  the  st.atic  checking  methods  is  limited  by  the  fact  that  neither  the  dy- 
namic computer  components  nor  the  initial  conditions  are  checked,  and  thus  errors  from 
such  sources  as  malfunctioning  integrators  cannot  be  detected.  Furthermore,  deripite 
the  work  reported  in  Secs.  4 and  5,  the  corz  eiation  between  the  static  accuracy  and  the 
eyrors  in  the  solutions  is  unknown.  It  is  not  possible  to  specify  the  allowable  static - 
accuracy  limits  with  respect  to  allowable  solution  errors.  Therefore,  dynamic  checking 
methods  must  be  developed  to  test  the  computer  more  completely.  A number  of  these 
methods  have  been  devised,  ranging  frorr.  very  simple  measurements  of  the  time  response 
of  single  components  to  deiermining  the  response  of  the  over  -all  computer  system  as  set 
up  to  solve  a specific  p.roblem.  For  example,  one  of  the  simplest  checks  consists  in  de- 
ter minizig  c s;i  increase  of  the  output  of  an  integrator  for  a constant  input.  On  the 

other  hand,  one  of  the  most  informative  but  complicated  dynamic  checks  i.s  comparison 
of  the.  computex'  solution  with  a solution  that  has  been  computed  by  numerical  techitiqucs 
of  known  accuracy.  These  numerically  calculated  aolutiouH,  or  check  solutions,  provide 
the  most  satisfactory  way  yet  discovered  for  securing  complr.t  >,  aaBura.nce  that  the  corn- 
puier  i«  operating  correctly. 

Generally,  the  dynamic  checking  methods  require  much  more  advanced  preparation 
than  the  static  checking  methods.  A complete  check  solution  foa  a complicated  set  of  dif- 
ferential equations  may  require  several  months  to  calculate  by  hand  with  a desk  cor^puting 
machine.  Furthermore,  such  problems  are  difficult  to  solve  on  existing  digital  computing 
equipment  because  the  storage  and  programing  requirements  become  very  great  for  prob- 
lems of  this  class.  The  most  complicated  static  checks,  on  the  other  hand,  require  at 
most  a lew  hours  of  advance  computaticn. 
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The  majority  of  the  dynamic  checks  used  with  the  M.I.T.  Flight  Simulator  fall  in- 
to two  classes,  open-loop  checks  and  closed-loop  checks.  This  division  ariflv»s  from  the 
fact  that  most  of  the  problems  solved  on  the  computer  are  in  the  form  of  one  or  more 
major  feedback  loops  plus  numerous  minor  feedback  channels,  coiriplete  clieck  solu- 
tion provides  the  most  extensive  closed-loop  test.  Here,  the  computer  is  operated  in  its 
normal  manner  with  all  feedback  loops  closed.  However,  it  is  also  often  convenient  to 
break  some  of  the  feedback  loops  in  one  or  more  piaces  and  test  the  dynamic  response 
either  of  an  entire  loop  of  the  computer  or  merely  of  part  of  the  loop.  Testa  with  the 
loop  thud  broken  are  referred  to  as  open-loop  dynamic  checks. 

Closed-loop  dynamic  checks  possess  the  advantage  that  they  provide  a better 
measure  of  the  ovcr’^ail  oper.ation  of  the  computer  than  open-loop  checks.  Also  more 
reliable  numerical  techniques  are  available  for  calculating  closed-loop  check  solutions. 

On  the  other  hand,  with  the  feedback  loops  closed,  errors  generated  by  any  components 
in  the  computer  propagate  through  the  entire  computer,  Thus  it  is  very  difficult  to  lo- 
calize a malfunctioning  component  by  means  of  cUned-loop  measurtments  alone,  in 
open-loop  dynamic  checks  the  ction  of  the  computer  in  which  the  fault  occurs  is  at  once 
put  in  evidence,  and  it  is  pos  to  decrease  syatcmatSually  the  number  of  components 

included  in  the  dynamic  ehsc*'  urtsl  the  exact  location  of  the  fault  is  determined. 

In  making  an  open-loop  check,  a known  driving  function  is  inserted  at  the  beginning 
of  the  section  to  be  tested.  The  response  of  the  section  is  measured  and  coirnpared  with 
the  previously  calculated  correct  response.  The  known  driving  function  is  selected  with 
respect  to  its  availability  in  the  computev,  its  similarity  to  the  type  of  signals  occuiring 
in  the  actual  prob.em,  and  tie  ease  with  which  the  response  of  the  open-loop  section  may 
be  calculated.  By  a suitable  choice  of  the  driving  function,  a possibility  exists  for  c'>m- 
bining  the  advantages  cf  both  clo«cd-loop  and  open-loop  teste . Once  a check  solution  has 
been  calculated,  then  the  correct  signals  throughout  the  entire  computer  are  known.  By 
making  the-  operi-locp  driving  function  equal  to  the  signal  that  would  have  existed  at  ths 
same  point  in  the  closed-loop  system,  ii  is  possible  to  achieve  a number  of  advantages. 

In  particular,  such  open-lof'p  testing  signals  are  very  similar  to  the  signals  in  the  actual 
problem  to  be  solved.  Also,  one  numerically  calculated  check  solution  serves  for  both 
closed-  and  open-loop  chocks.  The  closed-loop  signals  are  usually  not  “inu30jda  or  other 
functions  that  can  be  generated  by  simple  combinations  of  computing  elements.  As  a con- 
sequence, the  use  of  such  driving  functions  requires  3.  special  input  device  for  their  gen  - 
eraticin,  for  exanaple.  a photoelectric  input  table  or  a digital-to-analogue  data  converter. 
Although  such  a device  has  not  yet  been  tried  with  the  Ki.I.T.  Flight  Simulator,  it  might 
prove  to  be  valuable. 

Ill  summary,  the  general  testing  methods  just  described  consist  of  static  and  dy- 
namic criiiicks.  The  ..ta'fic  check?  arc  iniierentiy  open-loop  checks.  The  dynamic  check.s 
can  be  either  open-  or  closed-loop  checks.  These  checking  methods  a-^e  generally  appli- 
cable to  almost  all  analogue  computers.  B’-  prof>er  application  .->f  the  checki;,  it  ie  pos- 
sible to  localize  quickly  and  eliminate  faults  due  to  human  mistakes  and  component 
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rnalfunctj.on.ings . After  the  tAults  have  been  removed,  it  ia  poswible  i 

dence  that  the  computer  it  opeiating  correctiv  by  the  periodic  application  of  over-all 

checks  such  as  t'ne  comparison  of  the  computer  ref^uda  with  check  soiutiona. 

4 

In  addition  to  the  general  methods,  Tvembath  in  his  thesis  discusses  a number  ol 
methods  of  error-checking  specifically  applicable  to  the  simulation  of  three-dimensional 
flight  paths.  Because  of  their  specific  -.lature  the  methods  v/ere  not  discussed  here,  but 
their  existence  should  be  mentioned  again  because  three-dimensional  simulation  is  of 
great  current  interest. 


7.  SUGGESTIONS  FOR  FUTURE  WORK 


The  direction  whi  h future  error • analysis  work  should  take  will  je  discussed  in 
this  section.  Several  specific  investigations  will  be  outlined  from  the  results  of  the  pre- 
ceding work. 

7.1.  Blind  Alleys. 

The  results  obtained  for  some  of  the  work  carried  out  last  year  show  that  certain 
investigations  should  be  abandoned.  The  negative  results  are  probably  the  most  signifi- 
cant accomplishments  because  »hey  show  conclusively  that  no  more  effort  should  be  put 
into  certain  areas.  Trie  studies  of  error  generation  in  computer  components,  error  prop- 
agation in  problems,  and  error  propagation  in  computers  have  demonstrated  that  from  a 
practical  standpoint  it  is  useless  to  attempt  to  calculate  the  specific  errors  introduced 
into  the  solution  o'  a problem.  The  calculation  of  specific  errors  requires  so  much  time 
for  problems  of  a practical  size  that  it  cannot  be  justified.  Excessive  time  is  required 
merely  because  so  much  data  must  ba  considered  in  calculating!  solution  errors.  Con= 
sequently,  the  use  of  large  computing  machines  appears  t->  offer  the  oniy  means  of  short- 
ening the  calculations.  In  most  cases,  the  use  of  such  machines  would  defeat  the  purpose 
of  the  error-analysis  program. 

The  studies  of  error  propagation  in  problems  and  in  computers  have  established 
that  tne  error-propagation  equations  can  be  assumed  to  be  linear.  Thus  certain  general 
properties  of  linear  equations  hold  for  the  error  equations.  In  particular,  because  of 
superposition,  it  is  possible  to  define  a problem  error  sensiiivity  that  is  a function  of 
the  problem  itself,  and  not  a function  of  the  specific  way  in  which  the  problem  is  solved. 

In  many  practical  problems,  it  is  feasible  to  evaluate  the  sensitivity.  Inste  trying 

to  calculate  problem  errors,  it  may  be  sufficient  to  evaluate  the  sensitivity  of  the  prob- 
lem in  ordor  to  estimate  whether  the  problem  ran  be  solved  satisfactority  on  a given  com- 
puter. Thus  d.n  investigation  which  should  be  pursued  is  the  correlation  of  sensitivity  to 
observed  errors  in  problem  solutions. 

One  way  to  establish  the  nature  of  the  correlation  wo.x’d  be  to  evaluate  an  i:mp>iiical 
function  that  perhaps  can  ho-  written  in  the  form 


Observ'frl  Sc’luticn  Erroris  ; Function  ^■sensitivity,  numbers  of  various  kinds  of 

computing  elements  vised  in  computer). 

The  observed  errors  can  be  evaluated  directly  from  a comparison  of  the  computer  solu- 
tion and  the  check  solution.  The  function  should  be  kepi  as  simple  as  pt  se  ible.  Thus, 
an  attempt  should  be  made  to  use  some  single,  simple  measure  of  the  see.  sitivity  togelhci 
with  a Biniple  measure  of  ho.v  the  problem  is  solved,  such  as  the  number  i>f  various  lands 
of  computing  elements  'used. 

There  are  a number  of  error-propagation  functioiia  that  make  up  error  sensi- 
tivity of  a problem.  The  most  unstable  propagation  function  appears  to  be  the  most  suit- 
able single  me.asurc  of  the  error  sensitivity.  Possibly  a simple  iteration  process  covtld 
be  developed  for  finding  thv^  most  unstable  propagation  function.  If  the  linear  error 
propagation  equations,  Eqs.  (9),  are  considered  as  a matrix  equation,  then  the  most  un- 
stable propagation  function  corresponds  to  the  characteristic  root  of  the  matrix  having 
the  largest  real  part.  Iteration  methods  for  finding  this  characteristic  root  are;  particu- 
larly sim.ple,  and  their  use  should  be  investigated  as  a means  for  shortening  the  work  in- 
volved in  calculating,  the  sensitivity.  A simple  method  for  estimating  sensitivity  com- 
bined with  an  empirical  function  for  predicting  solution  errors  would  provide  a much 
needed  rule  of  thumb  for  estimating  solution  errors. 

7.  2.  Analyzing  Operational  Experience. 

The  greatest  and  moat  valuable  progress  in  the  work  done  so  far  on  error  analysis 
has  been  the  devel'  mc'nt  of  practical  operational  techniques  for  locating  errors  in  com- 
puters. Consequently,  in  future  work  greater  emphasis  should  be  place<l  on  this  area. 

The  specific  methods  developed  have  been  accumulated  rather  haphasardis-  by  computer 
operators.  Effective  methods  have  been  arrived  at  by  trial  and  error.  Ii’.effective  pro- 
cesses have  been  gradually  discarded.  No  particular  effort  has  been  nvade  to  evaluate 
directly  'he  relative  effectiveness  of  different  methods.  In  order  to  increase  the  rata  of 
development  of  good  methods,  a more  orderly  analysis  and  evaluation  should  be  accom.- 
plisbtd.  A definite  effort  should  be  made  to  study  the  techniques  used  by  the  better  op- 
erat..rB  and  to  reduce  these  techniques  to  specific  written  methods.  Tb.e  effectiveness 
of  the  specific  written  methods  sho'jld  then  be  evaluated  through  their  application  by  less 
experienced  operators. 

A particular  techsiique  that  appears  to  be  promising  and  ihat  shoiald  be  developed 
further  is  the  \ise  of  closed-loop  test  signals  for  open-loop  tests.  The  advantages  of  such 
a procedure  were  outlined  in  Sec.  6.3.  The  process  requires  the  use  laf  some  sort  of 
input-data  device  that  can  .-'onvert  an  arbitrary  tabulation  or  plot  of  the  closed-loop  sig- 
nals into  electrical  computer  signals.  Arbitrary -function  generator  s can  be  used  for  this 
purpose,  A bank  of  these  generators  will  be  installed  shortly  in  the  M .1.  T.  Flight  Simu- 
lator and  should  provide  an  opportunity  to  obtain  some  practical  experience  in  using  the 
open-loop  tests. 
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7.3.  General  Error-Probability  Function. 

The  principal  reason  for  the  failure  to  attain  the  originally  desired  goal  of  the 
studies  of  error  generation  and  propagation  was  the  attempt  to  obtain  too  detailed  infor- 
matior;  tVu»  errors.  At  flrut  it  '•'as  t<^  "stiniate  the  snecific  errors 

aa  time  functions.  As  might  have  been  expected,  obtaining  such  detailed  information  re- 
quires coo  much  calculation  to  be  of  practical  use.  A more  practicable  objective  would 
be  the  determination  u(  the  average  or  statistical  properties  of  the  errors.  Moat  types 
of  errors  are  analyzed  on  a statistical  basis.  Indeed,  considerable  statistical  theory 
first  was  developed  aa  a means  of  treating  errors.  Also,  the  analysis  of  error  generation 
in  computer  components  showed  that  while  it  is  not  feasible  to  estimate  the  actual  time  - 
function  component  errors,  some  of  the  statistical  properties  of  the  errors  can  be 
measured  and  calculated  relatively  easi.ly.  As  a consequence  of  these  developments,  an 
attempt  should  be  made  to  set  up  and  evaluate  a general  error -probability  function. 

Such  a function  would  give  the  probability  of  solution  errors  as  ^ function  of  the 
problem  being  solved  and  of  the  niethod  used  for  its  solution.  The  function  could  include 
effects  of  the  probability  of  component  failure  and  the  probability  of  operator  mistakes 
as  well  as  the  effects  of  random  errors  generated  by  the  computer  components. 

The  effects  of  randofn  component  errors  can  be  included  easily  in  a general  proba- 
bility function.  Nevertheless,  it  :1s  act  easy  to  see  how  the  effects  of  systematic  com- 
ponent errors  can  be  included.  Some  sort  of  approximation  will  have  to  be  made  to 
randomise  the  total  effect  of  a number  of  systematic  errors.  However,  if  the  number 
of  systematic  errors  is  large,  as  it  will  be  for  a problem  using  many  computer  compo- 
nents, then  the  assumption  of  random  effects  may  be  reasonable. 

In  evaluating  the  general  error-probability  function,  the  fact  that  errors  propagate 
linearly  should  be  of  considerable  value  because  a large  amount  of  statistical  theory  that 
is  applicable  to  this  case  has  been  developed  recently.  The  linearity  of  the  propagation 
greatly  reduces  the  amount  of  data  that  must  be  known  about  generated  errors  in  order 
to  obtain  the  statistical  characteristics  of  the  output  errors. 
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